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SHADING THREE DIMENSIONAIi COMPUTER GRAPHICS IM?IGES 

This invention relates to the shading of three dimensional 
computer graphic images, and especially to graphic images 
generated in real time. 

5 Many three dimensional computer graphics images are 

modelled with perfectly flat or smooth surfaces. Usually 
these surfaces are constructed from a plurality of small 
triangles to which is applied either flat shading, or 
smooth shading as described in ^^Transactions on Computers" 

10 IEEE-20 (6) June 1971 pp 623 to 629 by Gouraud, H., 

graduated shading, or, less frequently Phong shading from 
CACM 18 (6) June 1975 pp 311 to 317 ^^Illumination for 
Computer Generated Pictures". Visual detail may be 
applied to these surfaces via the application of textures. 

15 These textures are generally two dimensional images and 
the process is similar to having an image painted onto a 
perfectly smooth wall. It does not model any surface 
roughness or any shading effects which might arise 
t he re from - 

20 In computer graphics the way in which light interacts with 
the surface is referred to as shading. One of the simpler 
models used for shading is known as Lambert or diffuse 
shading. It is computed as a function of the direction of 
the light illuminating the surface and the orientation of 

25 that surface. The orientation is represented by a unit 
vector perpendicular to the surface (a surface normal) . 
The light direction is also preferably assumed to be a 
unit vector which points from the surface to the point of 
illumination. In the case of flat shading the surface 

30 normal is considered to be constant across the entire 
surface. With Gouraud shading three surface normals 
defined at the vertices of each triangle are used. The 
shading at the vertices of the triangles is calculated 
from these normals. These shading values are then 
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interpolated across the entire surface. This is a 
satisfactory approximation in many cases. However, it does 
lead to shading problems such as mach banding and problems 
with specular highlights. 

Phong shading gives a superior result to this because it 
interpolates the surface normally across the triangle and 
then recalculates the shading at each pixel. However, 
both of these per pixel operations are considered to be 
relatively expensive computationally and, therefore, 
Gouraud shading is therefore more commonly used, 



10 



3D computer graphics often makes use of specular shading 
in addition to diffuse lighting. Specular shading is the 
modelling of glossy refections of lights. In both types 
of shading a common basis for the calculation of the 
15 shading to be applied is a vector dot product raise^i to a 
power. This is shown in equation 1 below. 

In ''simulation of wrinkled surfaces" by Blinn, J.F. in 
Siggaph 1978 pp 286 to 292 there is proposed the concept 
20 of bump mapping. This uses an adaptation of texturing to 
deviate surfaces normal on a pixel by pixel basis. The 
texture data used to form the derivation of the normal is 
referred to as the bump map. 

Although the position of the surface is not actually moved 
25 in 3D graphic space it appears rough because shading is 
performed with a surface normal which moves in direction 
as the surface is traversed. 

This process is known as surface normal perturbation. 
What is stored in the bump map is an amount by which the 
30 surface normal is to deviate from its previous value. 

Thus, in order to compute the shading applied to a surface 
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it is necessary to retrieve data about the deviation of 
the surface normal from the bump map prior to applying 
this deviation to the surface normal. The surface normal 
then has to be renormalised in dependence on the 
orientation of the surface to which it is applied. The 
shading calculation is then performed. 



The effect of this leads to realistic dynamic changes in 
shading as a light source moves relative to the surface. 
However, computationally the scheme is approximately the 
10 same as that of Phong shading and so to date has been 
restricted to non-real time applications. 

We have appreciated that an effect similar to that 
proposed by Blinn can be implemented with much less 
computational power thus enabling realistic changes of 
15 shading to be implemented in real time. 

Preferably this is implemented in addition to the usual 3D 
computer graphics rendering systems which are in common 
usage for texturing and shading. 

Preferably, after a surface has been rendered the bump map 
20 effects are applied as an additional pass over the 

surface. For each image element or pixel a bump map 
texture element is obtained in a way identical to the 
usual, texturing operation. Lighting values are also 
interpolated across , the surface on a pixel by pixel basis 
25 from the light sources in use. The lighting values for a 
particular pixel are combined with the bump map texel 
(texture element) to produce an alpha value and a colour 
and thereby look identical to the usual output of the 
texturing engine. These are then supplied to the usual 
30 blending units to apply the texture. Unlike the approach 
taken by Blinn each texel of the bump map stores the 
actual direction of the surface normal after perturbation 
rather than the displacements of the surface normal. 



ISDOCIO: <WO 9909523A1 I > 



wo 99/09523 PCT/GB98rt>2488 



- 4 - 

These normals are given in the surface's coordinate system 
which is preferably the polar coordinate system. Lighting 
values are similarly expressed in terms relative to the 
surface's coordinate system. 

The invention is defined with more precision in the 
appended claims to which reference should now be made. 

A preferred embodiment of the invention will now be 
described in detail by way of example with reference to 
the accompanying drawings in which: 
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Figure 1 is a block diagram of circuitry a first 
embodiment of the invention; 

Figure 2 is a schematic diagram showing the surface 
normal and its coordinate system; and 

Figure 3 is a block diagram of the bianp map hardware of 
15 Figure 1 . 

Figure 4 is a schematic diagram showing the surface normal 
and a Cartesian coordinate representation system in 
contrast with the polar coordinates of figure 2; 

Figure 5 shows schematically a linear filter applied to 
20 texels; 

As described above this invention relates to computer 3D 
graphics rendering systems and is applicable but not 
restricted to hardware based rendering systems. A 
hardware based system is described here by way of example. 



25 The first embodiment of the invention shown in Figure 1 
comprises a modified conventional 3D rendering system. 
Conventional 3D texture hardware 2 is used to apply 
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texture to the image and rending hardware 4 then shades 
the textured image. Conventionally a single connection is 
provided between these two hardware blocks. 

In the modified system of Figure 1 a store 6 is used for 
5 surface bump map direction parameters for a number of 

different bump maps. This stores a set of surface normals 
pointing in different directions in dependence on their 
location in the bump map. These are called up by the bump 
map hardware 8 which combines the lighting values for a 

10 particular pixel with the bump map data from the store 6 
to produce an alpha value and a colour. These are 
identical to the usual output of the 3D texture hardware 2 
and are then supplied to the usual blending unit which 
uses the alpha value to combine the colour with existing 

15 colour at that pixel in proportions dependent on the alpha 
value (alpha is between 0 and 1) . 

Thus, the system applies surface normal perturbation 
effects to a surface as one additional single pass to • . 
modify the existing texturing and shading. When it is 

20 determined that for a" given surface and picture element 
""pixel" that a bump map pass is required, then the 
appropriate surface parameters are obtained for that 
surface. The surface normal for that pixel is determined 
by accessing the bump map texture associated with the 

25 surface in a similar manner to existing texture mapping 

methods. A direction parameter is also calculated for the 
pixel by interpolation. This is similar to the RGB 
interpolation performed for Gouraud shading. Thus the 
alpha value and colour value are supplied to the blending 

30 unit. 

The bump map surface normals stored in store 6 are encoded 
in polar coordinate as shown in Figure 2 . Angle S 
represents the elevation of the surface normal and goes 
from 0 to 90**. Angle R is the rotation of the surface 



JSDOCID: <WO_9909523A1 J.> 



wo 99/09523 



PCT/GB98/02488 



- 6 - 



normal and goes from 0 to 360°. As the surface normal is 
a unit vector the length value is always I and so it is 
not required to store this. Thus a saving on memory is 
achieved. 

5 In one embodiment of the invention the per surface 

direction parameters for the lighting sources are also 
encoded in spherical coordinates with parameters T ranging 
from 0 to 90° and Q ranging from 0 to 360°. The dot 
product power function of equation 1 would then be 
10 implementated as shown below in equation 2. 

((1-^) H-/2(sin(5)sin(7) +cos(5)cos(7)cos(7?-e))y' 

The parameter H is a weighting value that lies in the range 
0 to 1. The surface direction parameters T and Q can be 
interpolated in a manner similar to that used in Gouraud 
15 shading. 

Another ombodiment would include the T and H per surface 
direction parameters as parameters k^, k^, thus giving the 
dot product power function shown below in equation 3. 

(^1 sin(5)+^3 cos(5)cos(R-Q))P 



20 



Typically these values would be calculated as shown below in 
equation 4. 



This gives further flexibility as well as reducing the 
complexity of the implementation in hardware. 
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An embodiment of the invention using the equation shown in 
equation 3 is illustrated in Figure 3. 

The elevation angle S for the surface normal is first 
passed to a sine and cosine unit 10 which computes the 
5 sine and cosine of the elevation and applies these to 
multipliers 12 and 14 where they are combined with 
lighting parameters kj and kj. At the same time, the 
rotation angle R of the surface normal has the rotation 
angle Q of the lighting value subtracted from it in 

10 subtracter 16. The cosine of this angle is then derived 
in cosine unit 18. The output of this unit is unsigned 
and is fed to a multiplier 20 where it serves to multiply 
the output of multiplier 14. The output of multiplier 12 
is then passed to an adder 22 where it is added to 

15 lighting parameter kj* 

The output of adder 22 and multiplier 20 are then passed 
to an add/subtract unit 24. A signed bit 26 supplied by 
the cosine unit 18 determines whether the adder adds or 
subtracts the output of multiplier 20 from the output of 
20 adder 22. 

The output of this adder is a signed 11 bit number which 
is supplied to a clamping unit which reduces it to the 
range 0 to 255 (8 bits) and outputs this to a power unit 
30 which raises its value to a power p which is supplied 
25 to the power unit. 

In this embodiment the S and R values obtained from the 
bump map texture are both encoded as 8 bit unsigned 
niombers. For S 0 to 255 represents angles of 0 to almost 
90'' (256 would represent 90*" exactly) while for R 0 to 255 
30 represents angles of 0 to almost 360° (256 would represent 
360° exactly) . 
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The units of Figure 3 show the number of bits and whether 
or not those integers are signed or unsigned. U x 
represents an unsigned x bit integer. While S x 
represents a signed x bit integer. 

5 Thus, the alpha output to the blending unit is provided 

along with a colour from the existing 3D texture hardware 
2 . The existing colour and the new colour are then 
combined in the blending hardware 4 to produce a new value 
for that particular pixel. 

10 Using this method has several advantages. Firstly^ storage 
of surface normals as polar co-ordinates makes the bump 
map data compact compared to the method of Blinn which 
used surface normal displacements. Furthermore, 
renormalisation of the surface normals is not necessary 

15 because of the nature of storage as surface normals. 

Finally, interpolation of light direction is a relatively 
straight forward calculation to be performed since in most 
scenes there will only be a small number of light sources 
on which the lighting direction has to be based. This 

20 enables rendering to be performed in real time . 

The bump mapping technique described above has some 
shortcomings. These are: 

1. Interpolation of the lighting direction given at each 
vertex is ^tricky' , as the direction is specified in polar 

25 coordinates. Although polar coordinates allow greater 

precision with the direction specification and do not need 
normalisation, to perform the interpolation requires 
significant modification to the iterator units. Because 
of this, the hardware can assxime that the light direction 

30 is constant across each polygon. This effectively 
eliminates Phong shading . 
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2. For similar reason, bilinear texturing computations 
are more complicated. Although some modifications were 
made to perform angular bilinear, the actual results are 
not ideal. 

5 3. The system cannot model light directions that are 
*below' the horizon - these must be converted to an 
approximate direction that is on the horizon. 

4. The software interface bears little resemblance to 
the actual hardware interface. This means extra work for 
10 the drivers or at least to the application. 

The second embodiment described below addresses these 
issues. To do this there are two major changes to the 
implementation : 

1. The light direction vector is now specified in 
15 '*X,Y,Z" fixed point coordinates. This is very similar to 
a typical software interface, in which the light direction 
vector is given in floating point coordinates. Ideally, 
the floating point vector will have been normalised. 



20 



2. The bump map texel directions are also now specified 
in Cartesian coordinates, except that one component can be 
eliminated due to redundancy. We thus only store ^'X" and 
"Z" per texel. 



The idea of specifying bumps and light directions in a 
local vertex coordinate system remains the same. 
25 Converting a height map to the new format is much easier 
than the old, since no trigonometry is required. 
Additionally, the new technique includes a ^glossiness' 
parameter that allows the modelling of specular 
highlights . 
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AS in the first embodiment each texel stores the ^angle' 
or ^surface normal' of the bumpy surface at that 
particular texel/ and it is assumed that the vector can 
lie anywhere within a hemisphere, as shown in figure 4. 

5 We are not interested in the length of this vector (as it 
is assiamed to be of unit length) but only in its angle. 
In the first embodiment, this vector was stored using 
polar coordinates, however these are a nuisance to 
interpolate . 

10 In the second embodiment, the vector is represented in the 
more usual Cartesian coordinate system. The obvious way 
to store this would be X,Y,Z, where Y is always positive, 
and X & Z are signed values, however, we are typically 
limited to only 16 bits. If, however, we scale the vector 

15 such that 

|Xs|+ Ys +IZ3I = 1 
then there is no need to store the Y component at all, 
since it can be derived from the other two values. Note 
that this vector is no longer of unit length. Also all 
20 components of this vector are (=1, and that the length of 
this scaled vector is also (=1. 

Expressing this in terms of a 16 bit texel, we would have 
the following: 

UNIT8 TexelX, TexelY; 

25 TexelX - ( (int) (Xscaled ♦ 127. Of)) + 127; 

TexelZ - ((int) (Zscaled * 127, Of)) == 127; 

This packs X and Z as offset, 8 bit values. That is, a 
value of 0 represents "^^Vi27/ while 254 represents ^^^V^^, . 
We use this notation rather than the usual 2's complement 
30 to make the bilinear interpolation straight-forward. 

To extract the X,Y and Z components Un the hardware', we 
do. . . 
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INT 9 BumpX, BuinpZ; 
UINT8 Bun^Y; 

BumpX = (TexelX - 127)* 2; 
BumpZ = (TexelZ - 127)* 2; 
5 BumpY = 255 - ABS (BumpX) - ABS (BumpZ); 

We are guaranteed that Y is positive as 

(ABS (BumpX) +ABS (BumpZ) ) must be <= 255. (The above could 
probably be expressed better) . 

TexelX and TexelZ can be the results from the 
10 linear/bilinear/trilinear filtering . 

One of the problems with the first embodiment is the 
behaviour of the bilinear filtering. With angles, there 
is a problem with wrapping around or taking the shortest 
interpolation path. This is eliminated with the X/Z 
15 scheme . 

The interpolation is performed with just the TexelX and 
TexelZ components/ and the Y is calculated from the 
filtered result. Since these values are in the range 
0.. 255, the standard RGB filtering hardware is directly 
20 applicable. For the following examples, only a linear 
^filter' will be used since both bilinear and trilinear 
are repeated linears. 

Figure 5 shows a view from above looking down on the bump 
direction hemisphere. The dotted diamond shape represents 
25 the limits of the scaled X and Z values, which when re- 
normalised with the computed Y value would stretch out to 
the boundary of the hemisphere. Three example linear 
interpolations in X and Z are shown. 

For Path A, the interpolation would result in an angle 
30 that goes up and over the pole of the hemisphere - which 
is ideal. The previous method would have chosen a path 
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that ran in a circle ^copying' the circumference. For 
Path B, the interpolation would stay close to the 
circumference of the hemisphere. Path C, should also 
result in a sensible interpolation with a rise and fall in 
5 the component. 

The only likely quibble with this scheme is that the rate 
of change of the angle may not be constant, but this seems 
very minor. 

To prevent loss of accuracy with fixed point 
10 implementations, it is important that the length of the 
vector should not decrease too greatly, since in a fixed 
point system, bits will be lost- In this encoding , the 
minimum length would occur when | Xs | = y^ = | | = Va, 
resulting in a length of V&. This loses less than 2 bits 
15 of accuracy, and so is acceptable. 

There are two things we must guard against. The first is 
that not all possible combinations of ^texel' contents are 
valid. Since we have specified that | Xg | + yg + | Zg | = 1 
a texel that has | x^ | + | | )l is clearly invalid. We 
20 must therefore, protect against such occurrences. 

The second point is that even if the original texeis are 
valid, there is a small chance that the bilinear unit will 
produce X and Z values which also just exceed these legal 
values . 

25 As with the alternate bump format the light direction 

vector is stored in Cartesian coordinates- The only space 
we have available is the Of f setRGB/original-BumpK values, 
as an example we may have 8 bits for each of the X, Y, and 
Z components. These values all need to be signed, and to 

30 keep a.ccuracy, it is assumed that the light direction 

vector is normalised before conversion to integer , The 
per-vertex values would therefore be calculated from. . . 
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inte VertX, VertY, VertZ; 

VertLightX = ((int) (LightDir(O) * 127. Of)) & OxFF; 
VertLightY = ((int) (LightDir(l) * 127. Of)) & OxFF; 
VertLightZ = ((int) (LightDir(2) * 127. Of)) & OxFF; 

5 Since we are assuming that each vertex light vector is of 
unit length and because we are using ^linear' 
interpolation, the vector for a particular pixel will have 
a length that is (=1. As with the bump map, it is 
important that the in-between vectors are not too short or 
10 else too much accuracy will be lost. 

If we assume that the maximum sensible angle difference 
will be 120°, then the shortest vector will be sin (30'') = 

We will therefore only lose about 1 bit of accuracy due 
to the shortening of vectors. 

15 To have the chance of 'smooth' animation, it is important 
that small changes in light direction can be modelled. 
This will be of maximum importance near where the light 
direction = (0,1,0) ie. on the horizon so examining the 
minimum integer variation that seems possible we get 

20 [2,254,0]. This appears to be about an angle of 0.1 

degrees, which seems small enough. 

The shading ''dot product" computation is much simpler than 
it is with polar coordinates and is implemented in a well 
known manner. 

25 To simulate glossy highlights, a ^power' function is 

usually applied to the dot product so that bright areas 
become concentrated. The typical Phong lighting model 
raises the dot product to an arbitrary power, but this is 
too expensive to implement in hardware. 

30 A cheaper, but more than satisfactory function is to use a 
quadratic approximation as shown below. 
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Let X be the result of the dot product, 

C be a ^fixed point' 8 bit concentration value, where C=0 
(==0.0) gives a linear output, and C=255 (==1.0) gives 
maximum concentration. 

5 We compute . , . 

• k=C+8; (k is a 9 bit value with 3 bits of fraction) 

• L=MAX(0, 1023-(k* (1023-X)» 3) ) ; l is a lo bit 

fractional value 

10 • Q=(L*L))>10 Q is a 10 bit fractional value 

• P=L+C*(Q-L)»8; 

P is then the fixed point result of the power function. 
Note that Q^L and so the final calculation will require 
signed maths. 

15 In total, the highlight function will require 5 

add/subtracts and 3 multiplies, although a couple of these 
are rather simple degenerate cases. 



Thus, it will be appreciated that preferred embodiments of 
the present invention provide a system which enables 
20 textured surfaces to be shaded much more efficiently than 
has been possible. 
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CLAIMS 

1. A method for shading a three dimensional textured 
computer graphic image comprising the steps of : 

providing data defining the three dimensional computer 
graphic image ; 

applying texture data to the image; 

providing a set of surface normal vectors corresponding 
to the texture data applied to the image; 

providing data defining at least one light source 
illuminating the image; and, 

for each pixel in the image, deriving a shading value to 
be applied to that pixel from the set of surface normal 
vectors and the light source data. 

2. A method according to claim 1 in which the surface normal 
vectors are stored in polar coordinates . 

3 . A method according to claim 1 or 2 in which the light 
source data is stored in polar coordinates. 

4. A method according to claim 1 in which the step of 
deriving a shading value to be applied to a pixel comprises 
deriving a colour value and a blending value from the light 
source data and combining this colour value with existing 
colour data from that pixel in dependence on the blending 
value . 

5 . A method according to claim 1 in which the surface normal 
vector is stored in Cartesian coordinates. 

6. A method according to claim 1 or 5 in which the light 
source data is stored in Cartesian coordinates. 

7. A method according to claim 5 in which for each surface 
normal only two of the Cartesian coordinates are stored. 
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8 . A method according to any preceding claim comprising the 
step of applying a linear filter to the texture data at least 
once to map values to individual pixels. 

9 . A method according to any preceding claim including the 
step of applying a glossiness parameter to a pixel. 

10. Apparatus for shading a three dimensional textured 
computer graphic image comprising: 

means for providing data defining the three dimensional 

computer graphic images- 
means for applying texture data to the image; 
means for providing a set of surface normal vectors 

corresponding to the texture data applied to the image; 

means for providing data defining at least one light 

source illuminating the image; and' 

means for deriving a shading value to be applied to each 

pixel in the image from the set of surface normal vectors and 

the light source data. 

11. Apparatus according to claim 10 in which the surface 
normals are stored in polar coordinates. 

12 . Apparatus according to claim 10 or 11 in which light 
source data is stored in polar coordinates. 

13 . Apparatus according to claim 10 in which the surface 
normals are stored in Cartesian coordinates. 



14. Apparatus according to claim 10 or 13 in which the light 
source data is stored in Cartesian coordinates. 



15. Apparatus according to claim 13 in which for each surface 
normal only two of the Cartesian coordinates are stored. 

16. Apparatus according to any of claims 10 to 15 comprising 
means for applying a linear filter at least once to the 
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texture data to map values onto individual pixels. 

17* A method according to claim 10 in which means for 
deriving a shading value to be applied to a pixel comprises 
means for deriving a colour value and a blending value from 
the light source data and means for combining the colour value 
with an existing colour value in dependence on the blending 
value . 

18. A method for shading a three dimensional textured computer 
graphic image substantially as herein described. 

19. Apparatus for shading a three dimensional textured 
computer graphic image substantially as herein described with 
reference to the drawings. 
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